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CROSS REFERENCE TO RELATED APPLICATIONS 
5 The present application claims priority from United States provisional patent 

application serial number 60/362,590 filed on February 27, 2002, hereby incorporated 
by reference. 

TECHNICAL FIELD 

10 The present invention relates to the field of identifying and locating soimd-emitting 
objects using acoustic detection. 

BACKGROUND ART 

Passive identification, location and tracking of sound-emitting objects is generally 
15 performed by a system that includes an array of sensors used to detect acoustic waves 
produced by sound emitted firom the object. Signals produced by the array of sensors 
in response to detection of the acoustic waves are determined in time and space. 
However, the information contamed in these signals depends not only on the object 
emitting the sound but also on the number of sensors in the array and the geometry of 
20 the array. 

A typical method for extracting location information from the signals obtained from 
the array is time difference of arrival (TDOA) whereby the difference between 
detection time of the acoustic wave at two sensors is exploited to determine the 

25 object's location. Successful application of TDOA has been limited to far field 
applications (i.e. when the object is assumed to be far enough away from the two 
sensors that acoustic waves can be assumed to be planar), with inaccuracies occurring 
in near field applications (i.e. distance to the object is less than ten times the distance 
between the sensors in the array and acoustic waves are spherical). The limited 

30 application of TDOA in near field situations has restricted locating sound-emittmg ' 
objects due to difSculties in separating multiple sound emissions of the same object 
from multiple tracks of other objects. Identification of objects has been hindered by 
the high number of repeated measurements needed to characterize individual objects. 
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DISCLOSURE OF THE INVENTION 

In accordance with one aspect of the present invention there is provided a method of 
locating an object producing an acoustic wave, the acoustic wave being detected by a 
5 plurality of passive acoustic detectors formed in an array to produce at least three 
signals, the method comprising: (a) determining a wavelet correlatable with each of 
the at least three signals, said wavelet being derived from an acoustic wave of a 
known form; (b) determining time difference of arrival (TDOA) measxirements 
between the at least three signals using correlation intensity with said wavelet; (c) 

10 performing acoustic reciprocity at a pre-determined time interval from each of the 
plurality of detectors based on said TDOA measurements resulting in a hemisphere 
centered around each of the plurality of detectors; (d) exainiiung hemispheres 
produced from step (c) to determine an intersection point of at least three 
hemispheres; and (e) repeating (c) and (d) with a further time interval to increase the 

15 size of said hemispheres if said intersection point is not determined; wherein said 
intersection point represents a location of the object. 

In accordance with another aspect of the present invention there is provided a method 
of locating an object producing an acoustic wave by passive detection of the acoustic 

20 wave, the method comprising: (a) producing at least three signals from detection of 
the acoustic wave at a plurality of passive acoustic detectors formed in an array; (b) 
determining a wavelet correlatable with each of the at least three signals correlates, 
said wavelet being based on an acoustic wave of a known form; (c) determining time 
difference of arrival (TDOA) measurements between said at least three signals using 

25 correlation intensity with said wavelet; (d) performing acoustic reciprocity at time 
intervals from each of said plurality of detectors based on said TDOA measurements 
resulting in a hemisphere centered around each of said plurality of detectors; and (e) 
examining hemispheres produced from step (c) to determine an intersection point of at 
least three hemispheres at each of said time intervals; wherein said intersection pomt 

30 represents a location of said object. 

In accordance with a fiirther aspect of the present invention there is provided a system 
for locating an object producing an acoustic wave by passive detection of the acoustic 
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wave, wherein at least three signal are produced by detection of the acoustic wave at a 
plurality of detection points, the system comprising: an object characteristic library 
containing wavelets derived from acoustic waves of known form; a correlation 
mechanism for correlating the at least three signals with a wavelet from said object 
5 characteristic library; a time difference mechanism for determining time difference of 
arrival (TDOA) measurements between each of the at least three signals using 
correlation intensity with said wavelet from said correlation mechanism; an acoustic 
reciprocity mechanism for performing acoustic reciprocity at time intervals forming 
hemispheres centered around each of the plurality of detection points based on said 
10 TDOA measurements from said time difference mechanism to determine an 

intersection point of at least three hemispheres; and a controller for coordinating said 
correlation mechanism, said time difference mechanism and said acoustic reciprocity 
mechanism; wh^ein said intersection point represents a location of the object 

1 5 In accordance with yet another aspect of the present invention there is provided a 
computer readable medium having stored thereon computer-executable instructions 
for locating an object prodiicing an acoustic wave, the acoustic wave being detected 
by a plurality of passive acoustic detectors formed in an array, the method 
comprising: (a) determining a wavelet correlatable with each of the at least three 

20 signals correlates, said wavelet being derived from an acoustic wave of a known form; 
(b) determining time difference of arrival (TDOA) measurements between the at least 
three signals using correlation intensity with said wavelet; (c) performing acoustic 
reciprocity at a pre-determined time interval from each of the plurality of detectors 
based on said TDOA measurements resulting in a hemisphere centered around each of 

25 the plurality of detectors; (d) examining hemispheres produced from step (c) to 

determine an intersection point of at least three hemispheres; (e) repeating (c) and (d) 
with a ftirther time interval to increase the size of said hemisphere if said mtersection 
point is not determined; and wherein said intersection point represents a location of 
the object 



In accordance with yet a ftirther aspect of the present invention there is provided a 
system for locating an object in flight producing an acoustic wave by radar detection 
and by passive detection of the acoustic wave, wherein a radar system detecting the 
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object produces a path for the object and wherein at least three signals are produced 
by detection of the acoustic wave at a plurality of detection points, the system 
comprising: an object characteristic library containing wavelets derived from acoustic 
waves of known form; a correlation mechanism for correlating the at lest three signals 
with a wavelet fiom said object characteristic library; a time difference mechanism for 
determining time difference of arrival (TDOA) measurements between each of the at 
least three signals using correlation intensity with said wavelet from said correlation 
mechanism; an acoustic reciprocity mechanism for performing acoustic reciprocity 
time intervals forming hemispheres centered around each of the plurality of detection 
points based on said TDOA measurements from said time difference mechanism to 
determine an intersection point of at least three hetnispheres, wherein said intersection 
point represents a location of the object; a controller for coordinating said correlation 
mechanism, said time difference mechanism and said acoustic reciprocity mechanism; 
and a comparator for comparing said location with the path from radar detection to 
verify said location. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be described in conjunction with the drawings in which: 
Fig.l is a detailed system diagram of an acoiistic location system according to an 
embodiment of the present invention; 

Fig. 2 is an example of a suitable computing environment in which processrag 
functions of the present invention may be implemented; 

Figs. 3 A and B are a flow chart representing a method of identifying and locating a 
sound-emitting object according to an embodiment of the present invention; 
Fig. 4 is a system diagram of a radar guided acoustic system for locating and 
identifying objects in flight according to an embodiment of the present invention; and 
Figs. 5A, B and C are a flow chart representing a method of locating and identifying 
objects in flight. 

BEST MODE FOR CARRYING OUT THE INVENTION 

Fig. 1 shows an acoustic location system 100 for identifying and locating moving and 
stationary objects via sound emitted from these objects. The acoustic location system 
100 passively monitors a source of acoustic waves, the moving or stationary object. 
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and derives location and identification information for tiie object from acoustic waves 
that are received at the acoustic location system 100. The acoustic location system 
100 may be configured to identify and locate one or more specific type(s) of target 
object(s) or all received acoustic waves may be processed to determine the type of 
5 object from which the acoustic waves originated and the location of the object. 

The acoustic location system 100 is composed of two primary components: a sensor 
array 102 and a processing system 106. The sensor array 102 includes a plurality of 
individual acoustic sensors 104 that passively monitor for acoustic waves. Acoustic 

10 waves detected by the sensors 1 04 of the sensor array 1 02 are provided to the 

processing system 106 where the time of detection and location of detection of the 
acoustic waves in the array 102 is used to determine the location of the object 
Various characteristics of the acoustic waves such as strength and time-frequency 
spectrum can be exploited by the processing system 106 to determine tiie identity of 

15 the object given known characteristics for known or target objects. Processing 

functions of the acoustic location system 100 are performed by the processing system 
106. 

Fig. 2 and the associated description represent an example of a suitable computing 
20 environment 10 in which the processing system 106 of the present invention may be 
implemented. While the processing system 106 will be described in the general 
context of computer-executable instructions of a computer program, the processing 
system 106 can also be implemented in combination with other program modules. 

25 Generally, program modules include routines, programs, components, data structures 
and the like that perform particular tasks or implement particular abstract data types. 
Further, the processing system 106 of the present invention can also be implemented 
using or in combination with other computer system configurations, including hand- 
held devices, multiprocessor systems, microprocessor-based or programmable 

30 consumer electronics, minicomputers, mainfi^e computers, and distributed 

computing envnonments where program modules may be located in both local and 
remote memory storage devices. 
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With reference to Fig. 2, the processing system 106 may be implemented within a 
general purpose computing device in the form of a conventional computer 12, 
including a processing unit 30, a system memory 14, and a system bus 34 that couples 
various system components mcluding the system memory 14 to the processing unit 
5 30. The system memory 14 includes read only memory (ROM) 16 and random access 
memory (RAM) 20. 

A basic input/output system 1 8 (BIOS), containing the basic routines that help to 
transfer information between elements within the computer 12 (e.g. during start-up) is 

10 stored in ROM 16. The computer 12 further includes a hard disk drive 38 for reading 
from and writing to a hard disk (not shown), a magnetic disk drive 42 for reading 
from or writing to a removable magnetic disk 72, an optical disk drive 46 for reading 
from or writing to a removable optical disk 70 such as a CD ROM or other optical 
media and a magnetic tape drive 52 for reading from or writing to a magnetic tape 58, 

15 all of which are connected to the system bus 34 by respective interfeces 36, 40, 44. 
The drives 38, 42, 46, 32 and their associated computer-readable media 72, 70 
provide nonvolatile storage of computer readable instructions, data structures, 
program modules and other data for the computer 12. Although the exemplary 
environment described heremt employs certain disks, it should be appreciated by those 

20 skilled in the art that other types of computer readable media for storing data may also 
be employed. 

A number of program modules may be stored on the disks 72, 70, ROM 16 or RAM 
20, including an operating system 22, one or more application programs 24, other 

25 program modules 76, and program data 74. Commands and information may be 
entered into the personal computer 12 through input devices (e.g. a keyboard 64, 
pointmg device 68, a microphone, joystick, etc.). These input devices may be 
connected to the processing unit 30 through a serial port interface 48, a parallel port, 
game port or a universal serial bus (USB), A monitor 52 or other type of display 

30 device may also be connected to the system bus 34 via an interface, such as a video 
adapter 32. 
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The computer 12 operates in a networked environment using logical connections to 
one or more remote computing devices 56, such as another personal computer, a 
handheld device, a mini computer, microprocessor-based or programmable consumer 
electronics or any other such device capable of displaying graphics information. The 
5 logical connection depicted in Fig. 2 is a communications network 54, which may be 
a wireless network, a packet-switching network, etc. 

The computer 12 is connected to the communications network 54 through a 
commxmications module 50. The operations of the processing functions may be 
distributed between the two computers 12, 56, such that one acts as a server and the 
other as a client Operations of the processing functions for each computer 12, 56 
(client and server) may be stored in RAM 20 of each computer 12, 56 as application 
programs 24, other program modules 26, or on one of the disks 38, 42, 46. It will be 
appreciated that the network connections shown are exemplary and other means of 
establishing a communications link between the computers may be used. 

The processing system 106 of the acoustic location system 100 may be employed on 
the general computing device 12 shown in Fig. 2. The sensor array 102 of the 
acoustic location system 100 may be in communication with the processing system 
20 1 06 through the communications module 50 or via the communications network 54. 
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The sensor array 102, as depicted in Fig. 1, produces a signal that is representative of 
the acoustic waves received by the individual sensors 104. Each of the sensors 1 04 
may be any acoustic transducer that can passively monitor for acoustic waves, such as 
25 a microphone. The type of sensor 104 in the array 102 may be chosen based on the 
characteristics of the acoustic waves from the type of the target object (i.e. the type of 
the object that is desu-ed, or expected, to be located or identified). Thus, the 
transducing capabilities of the sensor array 102 may be varied according to the 
desired purpose of the system 100. 

30 

A direction in three-dimensional space can be defined by two angles (sideways and 
above), thus setting certain geometric constraints on the array 102. While a triangular 
sensor array 104 with four sensors is preferable, the system 100 can process signals 
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produced by sensor arrays 102 of non-standard geometries. The processing system 
100 can acconomodate such variations as sensors 104 at uneven heights, more than 
four sensors 104 in the array 102 and sensor 104 arrangements not based on 
equilateral triangles. The geometric configuration of the sensor array 102 may also 
5 affect the accuracy of the processing system's 106 determination of the location of the 
object. For example, a one-dimensional array 102 is symmetric in two dimensions; 
thus, a one-dimensional array can only define one of the angles on which a location is 
defined. 



10 Each of the sensors 104 in the array 102 is positioned according to its implementation 
environment to reduce noise interference and increase received acoustic waves firom 
the type of target object. To improve the processing of the produced signals to obtain 
information on the target object, sensors 104 are placed in the array 102 to allow 
reception of acoustic waves by more than one sensor 104. For example, if the type of 

15 target object is a bird in flight then the sensors 1 04 may be arranged to provide 
overlap between detection regions of individual sensors 104 at heights above the 
ground where birds are e3q)ected to be found. 

When an acoustic wave is produced in proximity to the array 102, the configuration of 
20 the array 1 02 is such that multiple sensors 1 04 will detect the acoustic wave. Due to 
the time delay produced by the separation of the sensors 104 and the propagation time 
of the wave, different sensors 1 04 will detect the wave at different times. The sensor 
array 102 may have a multiplexor for combining the individual signals produced by 
detection of the acoustic wave firom each sensor 104 in the array 102 to provide a 
25 single signal to the processing system 1 06. The single signal includes information 
regarding the timing and position of each detected component of the signal. 
Alternatively, the sensor array 102 may provide separate signals firom each of the 
sensors 104 to the processing system 106. The processing system 106 receives each 
of these separate signal m such a way as to associate relative timing and position of 
30 each of the received signals. 

The processing system 106 performs three main functions: storing the signal(s) from 
the sensor array 102, identifying the object and locating/tracking the object. Signals 
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received by the processing system 106 are adapted for storage in an array signal 
storage 1 10 by a converter 108* Signals stored in the array signal storage 1 10 are 
processed by a correlation mechanism 136 (through an acoustic controller 1 12)to 
determine a form for the acoustic waves detected by the array 102. A location for the 
5 object represented by the stored signal may be determined through a combination of 
time difference of arrival (TDOA) calculations between various sensors 104 in the 
array 102 that detected the acoustic waves from the object and acoustic reciprocity 
from those sensors 104. 

10 If the sensors 104 produce analog signals then the signals received directly by the 
converter 108 are converted into a digital signal by the converter 108 before being 
stored in the array signal storage 110. The converter 108 may include analog-to- 
digital signal conversion fimctions of the type known to those in the art 
Alternatively, the sensors 104 may produce digital signals that can be stored directly 

15 in the array signal storage 1 10 (i.e. signals from the sensor array 102 bypass the 

conversion ftinctions of the converter 108). Receipt of signals from the array 1 08 are 
aimounced to the acoustic controller 1 12. 

The controller 1 12 manages interactions between the various components of the 
20 processing system 106 involved in identifying the type of object and locating the 

object The correlation mechanism 136 processes the signals prior to object location 
processing to determine a form for the signal and a type for the object emitting the 
acoustic wave. Location of the object is determined through the interaction of a time 
difference of arrival (TDOA) calculation mechanism 116, a planar wave location 
25 mechanism 120 and a spherical wave location mechanism 124. 

The correlation mechanism 136 includes a comparison mechanism 132 that functions 
together with an object characteristic library 134 to provide a form for the acoustic 
wave and an object identification mechanism 1 14 that provides an object type for the 
30 object from which the acoustic waves were emitted based on the form of the acoustic 
wave. The controller 112 may request that the correlation mechanism 136 obtain a 
form of a signal or an identification of the object. If the form of the signal is to be 
obtained then the comparison mechanism 132 performs the processing. If the identity 
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of the object is to be obtained then the object identification mechanism 1 14 in 
conjimction with the comparison mechanism 132 perfonns the processing. Each 
signal derived firom an acoustic wave has distinguishing features that may be used to 
describe the signal and may be uniquely associated with the source object of the 
wave. These distmguishing features may include characteristics of the signal such as 
the range and value of the frequency spread of the signal, the time length of the signal, 
the detection range of the sensors 104 detecting the wave, whether the object location 
is likely to be considered near field or far field and the amount of the Doppler-shift. 
The distinguishing features of the signal may be correlated with a signal from a 
known source to identify the object 

Correlation of the stored signal with signals of a known form and possibly from 
known sources is performed through wavelet analysis. A description in the fonn of a 
wavelet for each form or type of object that is anticipated or desked to be detected is 
stored in the object characteristic library 134. Each wavelet m the object 
characteristic library 134 is from a signal with a known wave form that may have 
been obtained from a known object Every wavelet in the object characteristic library 
134 may optionally be classified as being from a known source or having a known 
form only (i.e. having an unknown source). A wavelet is a time-series signal that is 
localized in space and limited in frequency. Any arbitrary time-series signal can be 
decomposed into a sequence of wavelets constructed from a base wavelet and a 
number of spatially shifted and time-scaled replicas of it The signals with a known 
form are used to form other wavelets that are Doppler-shifted (compressed or 
stretched) version of the original signal. The base wavelet is considered to be a zero 
Doppler wavelet and the shifted wavelets are shifted from the zero Doppler wavelet in 
increments at a resolution of interest sufficient to provide shifted wavelets throughout 
a velocity range of the anticipated type(s) of objects. These shifted wavelets can 
account for effects that movement has on the signal from the object. 

Each wavelet in the object characteristic library 134 may include an identification of 
the object that emitted the signal on which the wavelet is based, the amount of shift 
from the original signal if the wavelet has been Doppler-shifted and the corresponding 
velocity of the object and the height range at which the object is expected to be 
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located. Information associated with each wavelet may be used to narrow the range 
of possible solutions to only those where the object may realistically be located, and 
whether the object is likely to be stationary or moving. Wavelet analysis involves 
fonning matched filters from the base signals as well as Doppler-shifted forms of the 
matched filter. 

The comparison mechanism 132 performs a comparison between the stored signal and 
the wavelets. The stored signal is compared with the wavelets in the object 
characteristic library 134 using known cross correlation techniques to determine if 
segments in the stored signal match any of the wavelets in the library 134. The 
comparison mechanism 132 may optionally examine only those wavelets that have a 
known form only (unknown source) when the controller 1 12 specifies obtaining a 
form for the acoustic wave. The degree to which there is an acceptable correlation 
between the stored signal and a wavelet may take into consideration variations that 
naturally occur in the signal. This matching process is perfomed by the comparison 
mechanism 132 for each signal from each sensor 104, with the end result being a 
single wavelet to which each signal corresponds to the acceptable degree. If an 
acceptable object type match for the stored signal is determined, any additional 
information associated with the matching wavelet is provided to the controller 1 12. 

When the type of the object from which the acoustic wave originated is to be 
determined, the object identification mechanism 1 14 may filter the signal first. If a 
specific object is desired to be isolated or if there are known sources of noise in the 
signal then the object identification mechanism 1 14 filters the stored signals to 
remove frequencies beyond the range of the specific object. After the initial filtering 
is performed, the object identification mechanism 1 14 provides the comparison 
mechanism 132 with the filtered signal where a match of wavelets may be performed. 
The comparison with wavelets by the comparison mechanism 132 may be specified to 
those wavelets that have a known source. 

The controller 1 12 examines the additional information from the correlation 
mechanism 136 to determine whether the object location is near or far and initiates 
processing of the stored signal by the appropriate mechanism. When the object 
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satisjGes far field conditions the acoustic waves emanating &om the object ate 
considered to be planar due to the distance they travel. When the object is in near 
field conditions the acoustic waves from tiie object are located so close to the sensors 
104 that they have a spherical shape. Due to the difference in the shape of the 
5 acoustic wave in far field and near field conditions, different processes may be used 
for determining the location of the object. 

The planar wave location mechanism 120 is provided with the stored signal by the 
controller 1 12 for determining a far field location for the object. The planar wave 

10 location mechanism 120 determines the location of the object using known time 
difference of arrival calculations for a planar acoustic wave. The planar wave 
location mechanism 120 determines the location of the object on the basis of a sensor 
array configuration in which four sensors 104 positioned in a configuration of 
equilateral triangles and acoustic wave detection occurring at all four sensors 104. 

15 Each sensor 104 in the array 102 will receive the acoustic wave firom the object at 
different times. Based on the time difference between arrival of the acoustic wave at 
two sensors 104 and the distance between the two of the sensors 104 and the 
geometry of the sensor array 102, a hyperbolic surface containing possible locations 
for the object can be produced using known TDOA calculation techniques that exploit 

20 geometry. Creation of hyperbolic surfaces from the relative detection times of three 
pair of sensors 104 provides the location of the object at the point of intersection of 
the three surfaces. 



The TDOA calculation mechanism 116 and the spherical wave location mechanism 
25 124 process the stored signal to determine the location of the object in the case of near 
field conditions. With a spherical wave the approaching wavefront expands 
spherically fix)m the source towards the sensor 104 such that the time of arrival of the 
wave at each sensor 104 defines the radius of the sphere firom the object to the sensor 
104. To determine the location of the object, spheres are expanded from the sensor 
30 104, according to acoustic reciprocity, based on the speed of sound and the time of 
arrival of the wave at the sensor 1 04. The intersection of spheres firom the different 
sensors 104 that detected the wave is the location of the object. 
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The TDOA calculation mechanism 1 16 is provided with signals from various sensors 
104 in the array 102 stored in the array signal storage 1 10 and relative times of 
detection at the sensor 104. The TDOA calculation mechanism 1 16 determines a 
difference in the time of arrival of the acoustic waves between various pairs of sensors 
5 104. The time differences between pairs of sensors 104 are stored in a TDOA 
combinations storage 118. 

The TDOA calculation mechanism 116 determines the TDOA between various 
signals produced by different sensors 104 according to characteristics of the signals. 

10 The signal was previously compared against the wavelet in the object characteristic 
library 134 by the object identification mechanism 1 14. The controller provides the 
TDOA calculation mechanism 1 16 with the identification of the corresponding 
wavelet. Since the corresponding wavelet is Doppler-shifted the effects of movement 
of the TDOA determination are accounted for if the same wavelet is used to determine 

15 the TDOA between all sensors 104. The TDOA calculation mechanism 1 16 

determines the amoxmt of delay for pairs of stored signals from different sensors 104 
based on the delay between the time of peak correlations of a stored signal and the 
corresponding wavelet in each of the stored signals. 

20 The TDOA as determined by the wavelet analysis is stored in the TDOA combination 
storage 118. Various TDOA measurements from signals from pairs of sensors 104 
are determined in a similar maimer and stored in the TDOA combinations storage 
118. 

25 The controller 1 12 has the TDOA measurements filtered by a validation mechanism 
122 to remove any measurements tiiat are invalid given characteristics of the sensors 
104, expected velocity of the object (as provided in the additional information) and 
weather patterns at the time of detection. The validation mechanism 122 compares 
the TDOA measurements with possible ranges in which an acoustic wave could be 

30 detected by the sensors 1 04 from the TDOA measurement. This possible detection 
range may be predetermined and involves a determination of the detection ranges of 
the individual sensors 104, the range of their overlap as well as the velocity at which 
the acoustic wave traveled including various weather effects. Given the TDOA 
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between the sensors 104 and the expected velocity of the object and accounting for 
delays that temperature and wind would make on the sound, the validation mechanism 
122 determines the maximum expected travel time for sound between two of the 
sensors 104. Any TDOA measurements exceeding the maximum expected travel time 
5 are considered to be invalid and are removed from the TDOA combinations storage 
118, 



After the TDOA measurements have been determined and validated, the controller 
1 12 has the spherical wave location mechanism 124 determine the location of the 

10 object If the object is moving then the corresponding wavelet would be Doppler- 
shifted from the origixial wavelet and the additional mformation supplied by the 
controller 112 would contain an indication of the amount of the Doppler-shifi. The 
spherical wave location mechanism 124 uses the indication of tiie Doppler-shifi from 
the additional information in determining the location of the object to account for 

15 frequency shifts in the stored signal resulting from the movement. The spherical 
wave location mechanism 124 uses acoustic reciprocity from the sensors 104 to 
determine the location of the object. If the time of emission of the acoustic wave 
from the object was known, hemispheres centered around the sensors 104 of radii 
adjusted for the time delay of detection at the sensors 104 would intersect at the 

20 location of the emitting object. Thus, the spherical wave location mechanism 124 
uses an iterative process with the earliest time being the first detection time and 
iteratively decreases the earliest time imtil an intersection between the spheres from 
each sensor 104 is found. 



25 The spherical wave location mechanism 124 includes an intersection determination 
mechanic 126 and a spherical expansion mechanism 128 that ftinction together to 
determine the location of the emitting object The spherical expansion mechanism 
128 includes a hemisphere generation mechanism 138 and a hemisphere expansion 
mechanism 140 that create and expand the hemispheres. The hemisphere generation 

30 mechanism 138 starts the spheres centered around the sensors 104 with the first time 
being the earliest time of detection. Since only one sensor 104 was the earhest to 
detect the acoustic wave, this sensor 104 would not have a sphere at the first time 
whereas the other sensors 104 would have a sphere. The radii of the spheres 
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corresponds with the TDOA difference between the sensors 104 and the speed of 
sound adjusted for weather effects. Since there would not be an intersection between 
all spheres at the first time, as one sensor 104 does not have a sphere, the spheres are 
expanded at a predetermined time interval* The hemisphere e>qpansion mechanism 
5 140 expands the hemispheres with a pre-determined time interval using velocity of the 
acoustic wave taking into consideration weather related variations. 



After each expansion the intersection determination mechanism 126 examines the 
hemispheres firom all of the sensors 104 to determine if there is an intersection 

10 between all of the hemispheres. The area of the hemispheres searched by the 

intersection detemiination mechanism 126 for an intersection point may be restricted 
such that the only area searched is within the maximum detection region of the 
sensors 1 04. Each time the hemispheres are searched and an intersection point 
between all spheres is not located the mtersection determination mechanism 126 

15 notifies the hemisphere expansion mechanism 140 that an intersection was not found. 
The hemisphere expansion mechanism 140 expands tiie hemispheres at another 
predetermined time interval with the new earliest time preceding the previous earliest 
time and the intersection determination mechanism 126 searches the resulting spheres. 
TTiis iterative process between the hemisphere expansion mechanism 140 and the 

20 intersection determination mechanism 126 continues until an intersection betvsreen all 
hemispheres is located or imtil the distance from the sensors 104 to the surface of the 
hemisphere reaches the maximum detection distance of the sensor 104. 



Figs. 3 A and B are a flow chart of a method 200 of identifying and locating a sound- 
25 emitting object according to an embodiment of the present invention. The signals 
firom the sensors 104 are digitized and stored in step 202. The stored signal is 
correlated with the wavelets in the object characteristic library 1 34 in step 204. A 
wavelet to which the stored signal firom each sensor 104 corresponds to an acceptable 
degree is determined in step 206. The corresponding wavelet is fi*om a signal of 
30 known form. As wavelets are also Doppler-shifted, the corresponding wavelet may 
also contain information as to the movement of the object. 
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Points of peak correlation between each signal and the wavelet are determined in step 
208. A time difference of these points between the different signals is measured in 
step 210. These TDOAs are validated in step 212 to ensure that they represent 
possible locations of the object. Validity of TDOAs may be based on possible 
s detection ranges of the sensors 104 and various weather effects by determining the 
maximum expected travel time between two sensors 104. Those TDOAs that are not 
valid are removed. 

A first sensor 1 04 in the array 1 02 that has the earliest time of detection of the 

10 acoustic wave is determined in step 214. The setisor 104 that first detected the 
acoustic wave fi*om the source object is considered to be at zero time for the initial 
iteration. Hemispheres centered over each sensor 104 are generated according to tiie 
TDOA measurement with the fibrst sensor 104 in step 216. The hemispheres around 
each sensors 104 are expanded with a predetermined time interval using the velocity 

15 of the acoustic wave in step 218. These expanded hemispheres are searched in step 
220 looking for a point of intersection of all hemispheres. If this point of intersection 
has not been found, as determined in step 222, then the time interval is examined in 
step 224 to determine if it is greater than the possible range of the sensors. If the time 
interval is greater than the possible range of the sensors then it is assumed that a 

20 location for the object cannot be determined from the stored signals. If the time 
interval has not exceeded the detection range of the sensors then the predetermined 
time interval is incremented in step 226 and steps 218 to 222 are repeated for a newly 
expanded set of spheres based on the new predetermined time interval. If an 
intersection has been found then the location determination process is finished, step 

25 228, and the location of the object is the location of the point of intersection. 

A radar guided acoustic system 300 for tracking object in flight according to a second 
embodiment of the present invention is shown in Fig. 4;. The radar guided acoustic 
system 300 has a radar portion 334 and an acoustic portion 332. The radar portion 
30 334 of the radar guided acoustic system 300 includes a system that can detect and 
track objects in flight. The radar portion 334 of the system 30 may be the radar 
system described in PCT/CA02/0103 1 filed on July 8, 2002 titied "Apparatus and 
Method of Tracking Objects in Flight," incorporated herein by reference. The radar 
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portion 334 of the radar guided acoustic system 300 may function simultaneoiisly 
with the acoustic portion 332 or the two may function cooperatively. The use of the 
two detection methods (radar and acoustic) in conjunction with each other provides a 
mechanism to confirm object location or detect an object by one method when the 
5 other method could not be used (e.g. the object did not provide an acoustic signal 
while tracked by radar or a radar return while detected acoustically.) 

The location of the object produced by the radar portion 334 may be used to assist the 
acoustic portion 332 in locating and identifying the object as radar has a farther 

10 detection range while acoustic detection has a closer detection range. That is, the 
radar portion 334 may detect the object before it is in range of acoustic detection. 
However, when the object gets closer to where detection is occurring, radar may fail 
to detect the object while acoustic detection may be successful. In this mode of 
operation detection of an object by the radar portion 334 cues the acoustic portion 332 

15 as to location of the object via first and last points on an object track determined by 
the radar portion 334. The last point in the track may be a projected point that is part 
of a predicted future path for the object The acoustic portion 332 then identifies the 
object and tracks the object through ranges for which the radar portion 334 cannot 
function. 

20 

Alternatively, the radar portion 334 and the acoustic portion 332 may function 
simultaneously to separately determine the location of the object. The radar guided 
acoustic system 300 has a comparator 330 that compares the two separately derived 
locations to determine of they correspond. 

25 

The radar portion 334 includes a radar anteima assembly 302 and a radar controller 
3 1 2 for obtaining radar data and a radar processing system 3 1 4 for determining the 
location of an object based on the radar data. The radar data contains two- 
dimensional information on the location of the object with respect to the radar antenna 
30 assembly 302 and the radar processing system 314 derives three-dimensional location 
information for the object from the two-dimensional location information. 
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The radar antemm assembly 300 includes a radar transmitter 306, a radar antenna 310, 
a radar receiver 308 and a turning gear 304. The radar transmitter 306 transmits pulse 
sequences through the radar antenna 310 under the control of the radar controller 312. 
The radar receiver 308 receives radar pulses that are reflected by object in flight back 
5 to the radar antenna 310. These received radar pulses indicate a range to the object(s) 
reflecting the radar pulses to the radar antenna 3 10 by means such as strength of 
received radar pulses. The turning gear 304 rotates the radar antema 3 1 0 in a 
predetermined scan pattern under the control of the radar controller 312. The two- 
dimensional location of the object is indicated by the range or strength of the received 
10 pulse and the azimuth location of the radar antenna 3 10 at the time when the reflected 
pulse was received. 

The radar controller 3 12 oversees the process of transmittmg and receiving radar 
pulses, including positioning and controlling movement of the radar antenna 310 via 
15 the turmng gear 304, the transmission fiequency and wavelength, radar pulse length 
and radar pulse sequencing, and a center frequency for radar pulse detection scanning. 
The radar controller 312 obtains the received mdar signal in an analog form and 
provides it to the mdar processing system 314. 

20 The radar processing system 314 derives a three-dimensional location for the object 
from the two-dimensional position information obtained from the radar signal. A 
converter 316 obtains the analog radar signal from the radar controller 312 and 
digitizes the signal for storage in a radar data storage 318. 

25 A radar controller 320 orchestrates processing of the radar signal to obtain the three- 
dimensional location. The radar signal is provided to a radar location determination 
mechanism 322 in the radar processing system 3 14 for determination of the three- 
dimensional location of the object. The radar location detemaination mechanism 322 
contains a straight path tracking mechanism 324 and an individual altitude 

30 determination mechanism 326, While both the straight path tracking mechanism 324 
and the individual altitude determination mechanism 326 estimate the third dimension 
(elevation angle) of the location of the object, the different mechanisms 324, 326 are 
used according to the shape of the resulting path of the object 
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The radar location determination mechanism 322 processes the radar signal to locate 
points of detection of the object at different times. These different points of detection 
are isolated to form a track for the object 

5 

. The straight path tracking mechanism 324 performs initial processing of all the points 
of detection in the track assxmiing that the track is straight. The straight path tracking 
mechanism 324 performs neutral regression on the track to determine the altitude of 
the track. The entire track is processed as a group of points of detection based on the 

10 assumption that all points of detection are at the same altitude and that the altitude of 
the object does not change within the distance tracked. The straight path tracking 
mechanism 324 assesses the curvature of the track at various possible elevation angles 
taken at a predetermined interval within a predetermined range of angles. Assessment 
of the curvature of the track may be based on any known technique for assessing track 

15 curvature. The track with the most desirable, possibly least, curvature from the tracks 
produced by these estimated elevation angles is selected and another series of tracks 
having elevation angles with a higher precision in a predetermined range of the 
elevation angle corresponding to the most desirable track is produced. The new series 
of tracks is similarly assessed for most desirable curvature. If the new desirable track 

20 can be considered straight then a track has been produced by the radar processing 
system and is provided to the acoustic portion 332 with the time of radar detection or 
to the comparator 330. 

If the new desirable track cannot be considered straight then the individual altitude 
25 determination mechanism 326 determines the third-dimension location for each point 
of detection. The individual altitude determination mechanism 326 considers each 
point of detection in the track and determines the altitude for each point based on 
azimuth bin estunation. The track with the third dimension is then provided to the 
acoustic portion 33*2 with the time of radar detection or to the comparator 330. 

30 

The acoustic portion 332 functions in a maimer similar to the system 100 in Fig. 1 , 
The sensor array 102 contains multiple sensors 104 that passively monitor for acoustic 
waves emitted from objects in flight. Signals produced by detection of these acoustic 
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waves Bxe provided to the acoustic processing system 106 where the identity of the 
object and the location of the object. 

The acoustic processing system 106 contains the converter 108 that receives the 
5 signals and converts them to a digital format if they axe in analog format and stores 
them in the array signal storage 110. The acoustic processing system 106 contains the 
acoustic controller 112 that orchestrates the process of identifying and locating the 
object. 



10 The stored signals are provided to the correlation mechanism 136 with the object 
identification mechanism 1 14 where wavelet analysis is performed to determine a 
wavelet to which all signals correspond. The corresponding wavelet comes from a 
known source which is used as the identifier of the source of the stored signals. An 
acoustic location determination mechanism 328 contains the TDOA calculation 

1 5 mechanism 1 1 6, the validation mechanism 1 22, the planar wave location mechanism 
120 and the spherical wave location mechanism 124 for determining the location of 
the object The TDOA calculation mechanism 116 determines the TDOA between 
various signals from various pairs of sensors 104 in the array 102. The validation 
mechanism 122 validates the TDOA measurements from the TDOA calculation 

20 mechanism 1 16 to ensure that they don't violate possible ranges of detection of the 
sensors 104. The planar wave location mechanism 120 determines the location of the 
object via a geometric calculation if it is determined that the object is located in a far 
field situation. The spherical wave location mechanism 124 determines the location 
of the object via acoustic reciprocity if it is determined that the object is located in a 

25 near field situation. After the location of the object has been determined by the 
acoustic location determination mechanism 328, the location is provided to the 
comparator 330 for comparison with the radar derived object location. 

The comparator 330 determines if the acoustic derived location and the radar derived 
30 location are within a predetermined range of each other. If the two location are within 
this range then there is confirmation as to the location of the object. If the two 
location are not within this range then this may mean that the target did not provide an 
acoustic signal while tracked by radar or a radar return while detected acoustically. 
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Figs. 5 A to C represent a flow chart of a method 400 of identifying and locating an 
object in flight using radar and acoustic detection according to an embodiment of the 
present invention. A radar pulse sequence is transmitted in step 402 and its reflection 
5 is received in step 404 along with an acoustic wave. The acoustic wave and radar 
signal are digitized in step 406 and stored in step 408. 

The radar signal is examined in step 410 to locate object in flight. Points of detection 
of the object in the stored radar signal are determined and isolated instep 412. An 
10 optimum path at an elevation angle within the beam of the radar pulse is determined 
in step 414 based on the points of detection. If the optimum path is not straight as 
determined in step 416 then the location of the object in three-dimensions at each of 
the points of detection is determined in step 418. A path from each of these 
individual locations is derived in step 420. 

15 

If the optimimi path is straight as determined in step 416 then object movement 
characteristics are determined from the path in step 422 and the future path trajectory 
is predicted based on the object movement characteristics in step 424. 

20 In step 426 the time period from which the points of detections were determined is 
derived. The stored signal is correlated with the wavelets in the object characteristic 
library 134 in step 428. A wavelet to which the stored signal from each sensor 104 
corresponds to an acceptable degree is determined in step 430. The corresponding 
wavelet is from a signal of a known fomi. As wavelets are also Doppler-shifted, the 

25 correspondmg wavelet may also contain information as to the movement of the 
object. 

Points of peak correlation between each signal and the wavelet are determined in step 
432. A time difference of these points between the different signals is measured in 
30 step 434 to form the TDOAs. These TDOAs are validated in step 436 to ensure that 
they represent possible locations of the object. Validity of TDOAs may be based on 
possible detection ranges of the sensors 104 and various weather effects by 
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detennining the maximum expected travel time between two sensors 104. Those 
TDOAs that are not valid are removed &om storage. 



A first sensor 104 in the array 102 that has the earliest time of detection of the 
5 acoustic wave is determined in step 438. The sensor 1 04 that first detected the 
acoustic wave firom the source object is considered to be at zero time for the initial 
iteration. Hemispheres cefitered over each sensor 104 are generated according to the 
TDOA measurement with the first sensor 104 in step 440. The hemispheres around 
each sensors 104 are expanded with a predetermined time interval using the velocity 
10 of the acoustic wave in step 442. These expanded hemispheres are searched in step 
444 lookmg for a point of intersection of all hemispheres. If this point of intersection 
has not been found, as determined in step 446, then tixe time interval is examined in 
step 448 to determine if it is greater than the possible range of the sensors. If the time 
interval is greater than the possible range of tiie sensors then it is assumed that a 
15 location for the object cannot be determined fix)m the stored signals. If the time 
interval has not exceeded the detection range of the sensors then the predetermined 
time interval is incremented in step 450 and steps 442 to 446 are repeated for a newly 
expanded set of spheres based on the new predetermined time interval. 

The acoustic derived location and the radar derived location are compared in step 452. 
If the acoustic derived location- is not within a predetermined range of the radar 
derived location, as determined in step 454, then the acoustic derived location and 
radar derived location may be disregarded 456. If the acoustic derived location is 
within a predetermined range of the radar derived location then the two location are 
presented in step 458^ 

It is apparent to one skilled in the art that numerous modifications and departures 
firom the specific embodiments described herein may be made without departing from 
the spirit and scope of the invention. 
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INDUSTRIAL APPLICABILITY 

The present invention relates to the industrial field of identifying and locating via 
passive acoustic detection. 



